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1 . Introduction 

The  sensitivity  of  the  optimal  value  function  of  a mathematical 
program  to  perturbations  of  the  problem  parameters  has  been  addressed 
by  a number  of  authors.  Using  point-to-set  maps,  Berge  [4]  derived 
conditions  sufficient  for  the  semi-continuity  of  the  optimal  value 
function  for  programs  with  constraint  set  perturbations,  and  provided 
a general  framework  for  some  of  the  earliest  work  on  the  variation  of 
the  "perturbation  function,"  i.e.,  the  optimal  objective  function 
value,  with  changes  in  a parameter  appearing  in  the  right-hand  side  of 
the  constraints.  Evans  and  Gould  [7]  gave  conditions  guaranteeing  the 
continuity  of  the  perturbation  function  when  the  constraints  are  func- 
tional inequalities.  Greenberg  and  Pierskalla  [13]  extended  the  work 
of  Evans  and  Gould  to  obtain  results  for  general  constraint  perturba- 
tions and  obtained  some  initial  results  for  programs  with  equality  con- 
straints. In  [15],  Hogan  established  conditions  sufficient  for  the 
continuity  of  the  perturbation  function  of  a convex  program,  and  in 
[16]  gave  conditions  implying  the  continuity  of  the  optimal  value 
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and  the  are  concave  on  S,  Hogan  [15]  has  given  conditions  that  imply 
that  the  directional  derivative  of  f*  exists  and  is  finite  in  all 
directions. 

For  programs  without  equality  constraints,  Robinson  [20]  has 
shown  that,  under  certain  second-order  conditions,  the  optimal  value 
function  satisfies  a stability  of  degree  two.  Under  this  stability 
property,  bounds  on  the  directional  derivative  of  f*  can  be  derived. 

For  convex  programming  problems,  Gol' stein  [12]  has  shown  that  a saddle 
point  condition  is  satisfied  by  the  directional  derivative  of  f*. 

Gauvin  and  Tolle  [11],  not  assuming  convexity,  but  limiting  their 
analysis  to  right-hand  side  perturbations,  extended  the  work  of 
Gol' stein  and  provide  sharp  upper  and  lower  bounds  on  the  directional 
derivative  limit  quotient  of  f*,  assuming  the  Mangasarian-Fromovitz 
constraint  qualification  and  without  requiring  the  existence  of 
second-order  conditions.  Sensitivity  results  for  infinite  dimen- 
sional programs  have  recently  been  obtained  by  Maurer  [18,19],  who 
developed  a representation  for  the  directional  derivative  of  the  sub- 
gradient of  the  optimal  value  function  of  such  problems. 

The  purpose  of  this  paper  is  to  extend  the  work  of  Gauvin  and 
Tolle  to  the  general  mathematical  program  in  which  a parameter  appears 
arbitrarily  in  the  constraints  and  the  objective  function.  For  this 
problem  we  obtain  the  Gauvin-Tolle  upper  and  lower  bounds  on  the 
directional  derivative  limit  quotient  of  the  optimal  value  function. 

The  mode  of  proof  closely  parallels  that  given  by  Gauvin  and  Tolle  [11]. 
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2 . Notation  and  Definitions 

In  this  paper  we  shall  be  concerned  with  mathematical  programs 
of  the  form: 


minx  f(x,e)  P(e) 

s.t.  g±(x, e)  > 0 (i=l m),  h.(x,e)  = 0 (j-l,...,p), 

where  xeEn  is  the  vector  of  decision  variables,  e is  a parameter  vector 

in  E , and  the  functions  f,  g^  and  h^  are  once  continuously  differen- 
n k. 

tiable  on  E x E . The  feasible  region  of  problem  P(e)  will  be  denoted 
R(e)  and  the  set  of  solutions  S(e).  The  m-vector  whose  components 
are  g^Cx.e),  i = l,...,m,  and  the  p-vector  whose  components  are 
hj(x,e),  j = 1 will  be  denoted  by  g(x,e)  and  h(x,e),  respec- 

tively. 

Following  usual  conventions  the  gradient,  with  respect  to  x,  of 

® n lc  1 

a once  differentiable  real-valued  function  f:E  xE  +E  is  denoted 

V f(x,e)  and  is  taken  to  be  the  row  vector  [3f (x,c)/3x1 , . . . , 3f (x,e)/3x  ]. 
x i n 

If  g(x,e)  is  a vector-valued  function,  g : EnxE^ *Em , whose  components 
g^x.e)  are  differentiable  in  x,  then  Vxg(x,c)  denotes  the  m x n Jacobian 
matrix  of  g whose  ith  row  is  given  by  V^g^x.e),  i = l,...,m.  The  trans- 
pose of  the  Jacobian  Vxg(x,e)  will  be  denoted  Vxg(x,e).  Differentiation 
with  respect  to  the  vector  e is  denoted  in  a completely  analogous  fashion. 
Henceforth,  we  do  not  distinguish  between  row  and  column  vectors  in  this 
paper;  their  use  should  be  clear  from  the  context  in  which  they  are  applied. 
The  lagrangian  for  P(e)  will  be  written 

m p 

L(x,p,u>,e)  - f(x,e)  - ^ v^g^x.e)  + ^ Wjhj(x,e), 
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and  the  set  of  Kuhn-Tucker  vectors  corresponding  to  the  decision  vec- 
tor x will  be  given  by 

K(x,e)  = { (p,cj)eEmxEp:V  L(x,p,cj,e)  = 0,  ^ > 0,  b.jg^x.e)  = 0,  i=l,...,m}. 

Writing  a solution  vector  as  a function  of  the  parameter  e,  the  index 
set  for  inequality  constraints  which  are  binding  at  a solution  x(e)  is 
denoted  by  B(e)  * (i:g  (x(e),e)  = 0}.  Finally,  the  optimal  value 
function  will  be  defined  as 

f*(e)  * min  (f (x,e) :xeR(e) } . 

Throughout  this  paper  we  shall  make  use  of  the  well  known 
Mangasarlan-Fromovitz  Constraint  Qualification  (MFCQ)  which  holds  at 
at  point  xeR(e)  if: 

i)  there  exists  a vector  yeEn  such  that 

Vx8i(x,e)  7 > 0 for  1 such  that  3 0 and  (2.1) 

V h.(x,e)  y = 0 for  j«l,...,p;  and  (2.2) 

x j 

ii)  the  gradients  V h.(x,e),  j=l,...,p,  are  linearly 

x J 

independent . 

We  will  also  have  occasion  to  make  use  of  the  notions  of  semi- 
continuity for  both  real-valued  functions  and  point-to-set  maps. 

There  are  several  equivalent  definitions  for  these  properties.  The 
ones  most  suited  to  our  purpose  are  given  below.  The  reader  inter- 
ested in  a more  complete  development  of  these  properties  is  referred 
to  Berge  [U]  and  Hogan  [17]. 
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Definition  2.1.  Let  $ be  a real-valued  function  defined  on  the  space  X. 


i)  <fr  is  said  to  be  lower  semi-continuous  at  a point  xqcX  if 

lim  <)>(x)  _>  ifc(xo)  • 
x-+x 

o 

ii)  $ is  said  to  be  upper  semi-continuous  at  a point  xqcX  if 

lim  <Kx)  1 4>(xo)  • 
x-*-x 

o 

Using  these  definitions,  one  readily  sees  that  a real-valued 
function  is  continuous  at  a point  if  and  only  if  it  is  both  upper 
and  lower  semi-continuous  at  that  point. 

Definition  2.2.  Let  <f>:X+Y  be  a point-to-set  mapping  and  let  {e^} 
with  en-*c  (c  in  X). 

i)  4>  is  said  to  be  lower  semi-continuous  at  a point  e of 

X if,  for  each  xe<}>(t),  there  exists  a value  nQ  and  a 

sequence  {x  } CY  with  x e4>(e  ) for  n > n and  x +x. 

^ n n n — o n 

ii)  $ is  said  to  be  upper  semi-continuous  at  a point  e of 

X if  x eii>(e  ) and  x ►x  together  imply  that  xe4>(e)  • 

n n n 

Following  Berge  [4],  we  denote  the  lower  (upper)  semi-continuity 
of  point-to-set  maps  by  l.s.c.  (u.s.c.);  for  real-valued  functions  we 
use  the  notation  lsc  and  use  for  lower  and  upper  semi-continuity, 
respectively. 


Definition  2.3.  A point-to-set  mapping  $:X-*-Y  is  said  to  be  uniformly 


compact  near  a point  c of  X if  the  closure  of  the  set  U4>(e)  is  com- 

c in  N(c) 

pact  for  some  neighborhood  N(e)  of  e. 


In  Section  3 we  apply  a reduction  of  variables  technique  to 


P(e)  which  transforms  that  program  to  an  equivalent  program  involving 


only  inequality  constraints.  This  approach  simplifies  the  derivation 


of  intermediate  results  which  are  needed  to  derive  the  bounds  on  the 


directional  derivative  limit  quotients  of  f*(e)  given  in  Section  4 


A demonstration  of  the  results  is  provided  in  the  example  of  Section  5 


Section  6 concludes  with  a few  remarks  concerning  related  results 


3.  Reduction  of  Variables 


In  P(e),  if  the  rank  of  the  Jacobian,  V h,  with  respect  to  x of 


the  (first  n)  equality  constraints  in  a neighborhood  of  a solution  is 


equal  to  n,  then  the  given  solution  is  completely  determined  as  a 


solution  of  the  system  of  equations  h,(x,e)  = 0,  j = 1 


(locally  unique)  solution,  x(e),  of  this  system  near  e = 0 is  then 


completely  characterized  by  the  appropriate  implicit  function  theorem 


depending  on  the  assumptions  about  e,  as  for  example  in  [9]  and  [20] 


We  are  here  interested  in  the  less  structured  situation  and  hence 


assume  that  the  rank  of  V h is  less  than  n.  Since  we  shall  be  making 


use  of  MFCQ,  this  entails  the  assumption  that  the  number  p of  equality 


constraints  is  less  than  n.  If  there  are  no  equality  constraints  in  a par- 


ticular formulation  of  P(e),  simply  suppress  reference  to  h in  the  follow- 


ing development.  Otherwise,  we  take  advantage  of  the  linear  independence 


assumption  to  eliminate  the  equalities,  again  using  an  implicit  function 


theorem 


If  the  mapping  h:E  xE  ->-EF  satisfies  the  following  conditions 


i)  h is  continuous  on  an  open  neighborhood  of  the  point 


Jacobian  V 


e ) and  is  continuous  at  that 


neighborhood  of  (x^.x^ 


point,  and 


e ) is  nonsingular 


where  x = (x  ,xT),  then  the  usual  implicit  function  theorem  results 


hold,  i.e.,  the  system  of  equations  hCx^.x^.e)  ' 

1 

x in  terms  of  xT  and  e for  any  x and  e near  x 


0 can  be  solved  for 


Furthermore,  this  representation  is  unique  and  the  resulting  function 


x (xt,e)  is  continuous  in  a neighborhood,  N , of  (x 


the  system  h(x  ,x  ,e)  « 0 is  satisfied 


Thus,  in  N 


identically  by  the  function  x^  - x^Xj.e).  Under  our  additional 
assumption  that  h is  once  continuously  differentiable  in  x and  e 


xn(xT,e)  is  also  once  continuously  differentiable  in  x.  and  e 


Applying  this  result  to  P(e),  near  (x 


0,  this  problem  can  be  reduced  to  one 


involving  only  inequality  constraints 
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where  fUj.e)  ; f [x^x^e)  .Xj.e]  and  ^(Xj.e)  i gj^IXpCxj.e)  .Xj.e]  for 
i - l,...,m,  and  where  the  minimization  is  now  performed  over  the  n-p 
dimensional  vector  x^.  The  programs  P and  P are  equivalent  in  a 
neighborhood  of  (x*,e*),  in  the  sense  that  the  point  x(c)eEn,  with 
x(e)  = (Xp(e) ,Xj (e)) , satisfies  the  Kuhn-Tucker  first-order  necessary 
conditions  for  an  optimum  of  P(e)  if  and  only  if  the  point  Xj(c)  satis- 
fies those  conditions  for  ?(e),  where  x^Xj.e)  is  as  given  above. 

We  now  show  that  the  Mangasarian-Fromovitz  constraint  qualifica- 
tion for  P(e)  is  inherited  by  the  reduced  problem  P(e).  For  simplicity 
in  notation,  and  without  loss  of  generality,  assume  that  e*  = 0,  assume 
that  x*  is  a local  solution  of  P(0),  and  assume  that  the  components  of 
x have  been  relabeled  so  that  x = (Xp.x^)  and  7x^h(x*,x*,0)  is  non- 
singular. We  first  state,  without  proof,  the  straightforwardly  proved 
equivalence  result  that  establishes  the  connection  between  local  solu- 
tion points  of  P and  P. 

Lemma  3.1.  If  f,g,hec\  and  the  once  continuously  differentiable  vector 
function  xQ  = x^Xj.e)  is  given  (e.g.,  by  the  implicit  function  theorem 
as  indicated)  such  that  h (x^(Xj , c) ,Xj , e)  - 0 in  a neighborhood  of 
(x*,0)  = (x^,x*,0),  then  near  c - 0,  the  point  x(e)  satisfies  the  Kuhn- 
Tucker  first-order  necessary  conditions  for  an  optimum  of  P(e)  if  and 
only  if  the  point  Xj(e)  is  a Kuhn-Tucker  point  of  ?(e) . Furthermore, 
near  e - 0,  x(e)  is  a local  solution  of  P (c)  if  and  only  if  Xj(e)  is  a 
local  solution  of  P(e),  where  x(e)  ■ (x^Xj  (e)  , t)  ,Xj  (c)  ) . 

If  there  are  no  inequality  constraints  in  P(c),  then  P(e)  is  an 
unconstrained  problem.  In  this  instance,  restriction  oi  x^  to  a com- 
pact set  containing  a solution  set  of  P(0)  makes  it  possible  to  obtain 
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immediately  the  directional  derivative,  D TaO)  (see  (4.1)  for  the 
definition)  of  7*(0),  the  optimal  value  of  P(0),  in  any  direction  z 


and  in  terms  of  xT , by  using  a result  due  to  Danskin  [5],  Since 


it  is  easy  to  calculate  the  corresponding  result  for 


Since  this  result  is  readily  obtained 


and  since  we  have  not  seen  this  development  in  the  literature,  we  give 


the  details  before  analyzing  the  more  difficult  situation  involving 


inequalities 


Assume  that  the  feasible  region  R(e)  of  P(e)  is  nonempty  and  uni' 


formly  compact  near  e » 0.  Then,  the  solution  sets  S(e)  of  P(e)  and 
S(c)  of  F(e)  will  exist  and  will  be  uniformly  compact  near  e » 0.  Con 


min  f(x  ,e)  s.t.  xteR,  a nonempty  compact  set,  independent 


of  e,  such  that  for  e near  0 the  interior  of  R contains  jT(e).  Danskin's 


result  (see  also  (6.1)  and  the  ensuing  discussion)  says  that  under  the 


assumed  conditions 


of  solution  points  of  P(0) . Since 


function,  and  since 


x.,c),x T, c]  =0,  it  is  easy  to  show  that 


7 f V h and  L is  the  Lagrangian  of  P(e)  (without  the 


where  w 


inequality  constraints).  Since  f*(e)  5 f (e),  it  readily  follows  that 


This  result  also  follows  as  a specialization  of  our  general  re 


suits  (see  Corollary  4.6  and  the  note  following  the  proof)  as  does 
Danskin's  result  (see  the  discussion  just  before  and  after  (6.1)).  It 


may  also  be  of  interest  to  observe  that  if  the  transformation 


x (xT,e),  or  any  nonsingular  transformation,  results  in  a problem 


whose  constraints  are  not  dependent  on  the  parameter  c,  then  the  above 


approach  applies,  the  domain  of  interest  of  the  transformed  problem 


simply  being  the  intersection  of  the  set  of  points  satisfying  the 


parameter-free  constraints  with  a compact  set  R selected  as  above 


We  now  turn  to  the  development  of  the  results  for  the  general 


problem  P(e)  where  it  is  assumed  that  both  inequalities  and  equalities 


then  MFCQ  holds  for  P(0)  at  (x' 


Theorem  3.2 


0)  with  y = (y  ,7  )eE  the  associated  vector,  where  y and 


if  and  only  if  MFCQ  holds  in  problem  P(0)  at  the  point 


0)  with  vector  y 


Proof . Suppose  that  MFCQ  holds  for  P(0)  at  (x 


0)  with 


(y  ,y  ) the  associated  vector.  Writing  V h as 


0)  is  nonsingular,  we  can  solve 


in  (3.1)  and  obtain 


Now,  denoting  the  inequality  constraints  of  P(0)  by  g , i.e 


m,  by  differentiating  with  respect 


to  xT  we  obtain 
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V1 


8i  VxT*D  + Vgi* 


or 


(3.3) 


Multiplying  by  y ^ in  (3.3)  we  have: 


Vxrgi  yI 


V 8. 
xsi 


\*D 

I 


(3. A) 


But  h(xD(x1,0)txI,0)  z 0 so  that 


vx^h(xD(xI,0) .Xj.O)  Vx^xD  + Vx  h(xD(xI,0) ,xT,0)  - 0, 


and  since  V 

*0 


h(xD(x1,0),xI,0) 


is  nonsingular,  we  obtain: 


V hOc^Xj.O)  ,xlt0) 


-1 


7x  h(xD(xI»°)»xI»°) 


Substituting  this  last  expression  in  (3.4)  we  have: 


\*i  yI  ’ 7xgi 


•IVXi)h(xD(xI.0)  .*I.°)1  Vx  h(xD(xI,0)  .Xj.,0) 


'I’ 


and  from  (3.2)  we  see  that  at  (x*,0) 


n *v  <s> 

Vx  8I  yI 


V g 

xRi 


- Vi  y. 


(3.5) 


Thus,  by  (2.1)  it  follows  that  > 0. 
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by  the  hypotheses  of 


we  first  note  that 


To  prove  the  converse 


0)  is  nonsingular.  Thus, 


the  implicit  function  theorem,  V 


p,  are  linearly  independent  and 


the  gradients  V h (x 


by  choosing 


(2.2)  is  satisfied  for  j ■ 1 


p.  The  inequality  in  (2.1)  now 


follows  from  (3.5),  a direct  consequence  of  (3.1) 


Gauvin  and  Tolle  established  that  the  set  of  Kuhn 


Tucker  multipliers  associated  with  a solution,  x 


non 


empty,  compact  and  convex  if  and  only  if  MFCQ  is  satisfied  at  x 


That  result  enables  us  to  establish  in  Theorem  3.3,  a necessary  link 


between  a directional  derivative,  with  respect  to  the  decision  vari 


able  x , of  the  objective  function  at  an  optimal  point  and  a direc 


tional  derivative  of  the  Lagrangian  taken  with  respect  to  the  parameter 


e.  It  is  this  relationship  which  eventually  leads  to  the  upper  and 


which  are  derived 


in  the  next  section 


For  notational  simplicity,  throughout  the  remainder  of  this 


paper  we  shall  refer  to  the  problem  functions  of  the  program  P(e) 


without  the  ' tilda'  notation.  The  distinction  between  reference  to 


P(e)  and  P(e)  should  be  clear  from  the  text.  Also,  the  decision 


variables  for  the  reduced  problem  will  not  be  subscripted,  and,  unless 


specified  to  the  contrary,  all  gradients  will  be  understood  to  be  taken 


with  respect  to  the  relevant  decision  variable 
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The  next  two  theorems  are  crucial  in  obtaining  the  sharp  bounds 
on  the  optimal  value  directional  derivative  limit  quotient.  They  show 
that,  at  a local  minimum  where  MFCQ  holds,  there  exists  a direction 
(in  En  P)  in  which  the  directional  derivative  of  the  objective  func- 
tion yields  that  portion  of  the  bound  attributable  to  the  constraint 
perturbation. 

Theorem  3.3.  If  the  conditions  of  MFCQ  are  satisfied  for  some 
x*eSf(0),  then,  for  any  direction  zcEk,  there  exists  a vector  yeEn  p 
satisfying: 


i)  -Vg^(x*,0)  y <.  zV^g^Cx* ,0)  for  ieB(O) , and 


(3.6) 


ii)  Vf(x  >0)  y ■ max  [-z  V'g(x  ,0)y]. 

, e 

UC K(x  ,0) 


Proof . Given  zeE  , consider  the  following  linear  program: 


(3.7) 


max 


The  dual  of  this  program  is  given  by 
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* 

min  Vf(x  ,0)  y 

y.v 

s.  t.  Vg^x  ,0)  y + gA(x  ,0)v^  >_  -z  V£gA(x  »0)  (i=l, . . . ,m) 

yeEn  **,  v^  unrestricted. 

* 

Since  MFCQ  is  assuned  to  hold  at  (x  ,0),  from  [11]  we  have  that 
K(x*,0)  is  nonempty,  compact  and  convex.  Thus,  the  primal  problem 
is  bounded  and  feasible.  By  the  duality  theorem  of  linear  pro- 
gramming, the  dual  program  has  a solution,  (y,v),  and  hence  there 
exists  a vector  y satisfying  (3.6)  and  (3.7). 

By  changing  the  sign  of  the  objective  function  in  the  primal 

* 

program  above,  thereby  maximizing  z V£g(x  ,0)p,  we  are  also  able  to 
conclude  the  following. 

Theorem  3.4.  If  the  conditions  of  MFCQ  are  satisfied  for  some 
x eS(0),  then  for  any  direction  ztE  , there  exists  a vector  ytE  p 
satisfying: 

i)  Vgi(x*,0)  y > zV^g^x  ,0)  for  ieB(O),  and  (3.8) 

ii)  Vf (x  ,0)  y = max  [zV'g(x  ,0)u].  (3.9) 

peK(x  ,0) 

By  taking  f(x,0)  = constant,  then  since  any  point  in  R(0)  solves 
?(0) , it  easily  follows  from  Theorems  3.3  and  3.4  that  there  exists  a 
vector  y satisfying  (3.6)  and  (3.8)  for  any  x*  in  R(0) . 

- 15  - 
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In  the  next  two  theorems  we  show  first  that,  along  any  ray  emi- 
nating  from  e = 0,  P(e)  has  points  of  feasibility  near  c = 0,  and 
second,  that  the  existence  of  feasible  points  is  guaranteed  not  only 
along  rays  but  in  a full  neighborhood  of  e * 0. 

Theorem  3.5.  Let  g:En  p x Ek  -*•  Em,  with  gcC^.  If  MFCQ  holds  at 

jL  ^ 

x eR(0)  then,  for  any  unit  vector  zeE  and  any  6 > 0, 

g(x*  + 0(y  + 67), Bz)  > 0 for  3 positive  and  sufficiently  near  zero, 

where  y is  any  vector  satisfying  (3.6). 

Proof . Let  z be  any  unit  vector  in  E and  consider  first  the  case 

* 

in  which  the  constraint  g^x.e)  >_  0 is  binding  at  (x  ,0).  Expanding 

* — * 
g^(x  + 0(y  + SyO.Bz)  about  the  point  (x  ,0)  we  obtain: 

gf(x  + B(y  + 6y),Bz)  = B(y  + 6y)  7x8i(x*+  t3(y  + 67), Bz) 

+ 3 z V gi(x*,t'Bz) 

= 8[y  vxEi^x*+  + &y)*&z')  + z Vtgi(x*,t'3z)] 

+ 06y  vxgi(x*+  tB(y  + 67), Bz), 

where  t,t'e(0,l)  and  t = t(0),  t'  - t’(3). 

ic 

Now,  by  (2.1),  ^xg1(x  ,0)  y ~ > 0.  Thus,  there  exists  6'  > 0 

such  that  for  all  3e[0,B'], 

* 3a 

y + ts(y  + 67), Bz)  >_  -J-  . 

From  (3.6)  it  follows  that  for  B sufficiently  small, 

y 7x8t(x*+  tB(y  + + z 7tgi(x*,t’Bz)  i - 6ai. 


16 


Thus 


0)  > 0,  since  each  g.  is  jointly  continuous 


Finally,  if  g (x 


in  x and  e,  it  follows  that,  for  any  unit  vector  zeE 


Theorem  3.6 


such  that  for  every  unit  vector  zeE  and  any  6 > 0 


g(x  + 3(y  + <5y),Bz)  > 0 for  all  Se(0,8],  where  y satisfies  (3.6)  and 


y is  given  by  the  constraint  qualification 


Proof . From  the  previous  result,  we  have  that  for  any  unit  vector 


8'(z,6,y,y)  such  that  for  all 


For  the  remainder  of  this  proof 


we  suppress  all  but  the  first  argument  of  3'  writing  3 


further  assume  that  8*(z)  = sup  (y:g(x  + 3(y  + <Sy),Bz)  > 0 for  all 


Suppose  there  is  no  value  3 which  satisfies  the  stated  condi' 


tion  for  all  unit  vectors  z.  Then  there  must  be  a sequence  (z  } of 


unit  vectors  from  E with  3' (z  )-K).  By  the  compactness  of  the  unit 


sphere,  there  exists  a unit  vector  zcE  with  z -*•  z for  some 


{z  }Q  {z  }.  Since  3'(z  )-*0,  there  is  an  integer  N such  that  for  all 


Relabel  the  subse 


quence  {z  :n  >_  N}  so  that  it  is  indexed  by  n = 1,2 


we  now  refer 
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to  this  subsequence  as  the  sequence  {z^}.  By  the  definition  of 
(3'(z),  we  must  have,  for  some  i = g^(x  + 6(y  + Sy),f5zn)  £0 

for  6c[8r(zn),  n)  for  some  n = n(zn) . However,  since  z^  -+  z and 
is  continuous,  there  must  be  an  integer  > N such  that 

g^(x  + 6(y  + 6y),6zn)  > 0 for  all  n _>  and  all  0e(O,8'(z)).  Since 

S'(zn)  < S'(z)  for  all  n _>  N,  we  have  a contradiction  and  the  proof 
of  the  assertion  is  complete. 


Since,  by  Theorem  3.3  and  the  observation  immediately  following 
Theorem  3.4,  the  satisfaction  of  the  Mangasarian-Fromovitz  constraint 
qualification  at  a feasible  point,  x*,  of  P(0)  is  enough  to  guarantee 
the  existence  of  feasible  points  for  P(e)  near  x*,  one  might  suspect 
that  there  exist  points  feasible  to  P(e)  which  are  also  feasible  to 
P(0).  This  is  indeed  the  case  as  the  next  theorem  implies  (see  the 
statement  immediately  following  the  proof  of  Theorem  3.7).  We  shall 
need  Theorem  3.7  in  obtaining  one  of  the  key  results  in  Theorem  4.3. 


Theorem  3.7.  Let  &n  0+  in  e\  let  z be  any  unit  vector  in  E^,  and 

let  6 > 0.  If  x eR(3  z) , with  x -*■  x*eR(0) , and  if  the  conditions  of 
n n n 

MFCQ  are  satisfied  at  x* , then  xn  + g^(y  + 6^r)cK(0)  for  n sufficiently 
large,  where  y satisfies  (3.8)  and  y is  given  by  the  constraint 

1 


qualification. 


Proof . Consider  first  the  case  that  icS(O) . Expanding  g^(xn  + 8n(y  + 6)T)  ,0) 

about  the  point  (x  ,6  z) , we  obtain: 
n n 
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I 

< 

I 


gi(xn  + BR(y  + <5jO*°)  = g^(xn>Bnz)  + 0n(y  + ByJVg^x^  + t8n(y  + 6)0,0) 

" 6nZ  Vf8i(xn  + 3n(^  + ^ * 1 ' 6nz) » 

where  t.t'eCO.l),  t = t(6n>,  t'  = t'(3n).  If,  for  n large, 

x + B (v  + 6yO^R(0),  since  x is  feasible  for  P(B  z)  > 0,  it  must 
n n n n — 

be  that 

Bn(y  + 6y0  Vg1(xn  +.  tBR(y  + 690,0)  < Bnz  vLgi(xn  + Bn(y  + <57),t'Bnz).  (3.10) 

Dividing  by  B^  in  (3.10)  and  taking  the  limit  as  n -*■  oo  we  have 
(y  + &S0  vgi(x*,0)  < z v£gi(x*,0). 

But  this  contradicts  (3.8),  since  6 > 0 and  by  MFCQ  y Vg^(x*,0)  > 0. 

If,  on  the  other  hand,  i^B(0),  g|(xn  + Bn(y  + ^y) ,0)  > 0 for 

large  n by  the  continuity  of  g,  and  the  fact  that  x ->  x*  and  6 ■*  0. 

1 n n 

Thus,  x^  + Bn(y  + 6y9tl?(0)  for  n sufficiently  large. 

It  may  be  interesting  to  note,  that  by  taking  x^  = x*+  Bn(y  + 6y) 
for  each  n in  the  hypothesis  of  Theorem  3.7,  then  Theorems  3.3,  3.4, 

3.6,  and  3.7  together  imply  that  R(e)  and  R(0)  have  points  in  common 
for  e near  0. 

We  now  show  that  the  optimal  value  function  f*(c)  is  continuous 
near  e - 0 under  the  given  assumptions.  This  was  proved  by  Fiacco 
[8],  the  details  being  repeated  here  to  make  this  paper  complete. 

This  result  will  be  needed  in  the  proof  of  Theorem  4.3. 
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Lemma  3.8.  If  R(0)  is  nonempty  and  J?(c)  is  uniformly  compact  for  e 
near  zero,  then  1T(e)  is  a u.s.c.  mapping  at  c = 0. 

Proof.  Let  + 0 in  E , and  (for  n sufficiently  large) , let 

xncR(cn> . Thus,  for  n sufficiently  large,  g(xn>en)  0.  By  the 

uniform  compactness  of  R(e) , there  exists  a convergent  subsequence 

{x  } of  {x  } with  x -+•  x for  some  x in  the  closure  of  UR(e)  , where 
nj  n nj  £ in  N (0) 

N(0)  is  some  neighborhood  of  e = 0.  But  by  the  continuity  of  g,  we 

must  have  0 £ lim  g(x  ,e  ) = g(x,0).  Thus  xcR(O)  and  we  have  that 

j-*0®  nj  nj 

R(e)  is  u.s.c.  at  e = 0. 

Theorem  3.9.  If  l((0)  is  nonempty,  R(e)  is  uniformly  compact  for  e 
near  zero,  and  if  the  conditions  of  MFCQ  hold  at  x*eS'(0) , then  f*(e)  is 
continuous  at  e = 0. 

Proof.  Let  •>  0 in  E , and  (for  n sufficiently  large)  let  xritS(en). 
By  the  uniform  compactness  of  R(e) , the  sequence  {x^}  admits  a con- 
vergent subsequence  {x  }.  Let  x denote  the  limit  of  that  subse- 

nj 

quence.  From  Lemma  3.8,  R(e)  is  a u.s.c.  mapping  at  e = 0,  so 
xtR(0) . Thus, 

lim  f*(r)  = lim  f*(c  ) = lim  f(x  ,c  ) = f(x,0)  > f*(0) , 

C-0  j-H»  "j  j-KJO  nj  nj 

and  we  see  that  f*(e)  is  lsc  at  c • 0. 

Now  let  6 > 0,  let  y be  given  by  MFCQ  for  x*,  and  let  y satisfy 
(3.6).  From  Theorem  (3.5)  we  know  that  x*  + B^(y  + ty)  eK(B^z) 
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lim  f* (e)  = lim  f*(e  ) < lim  f(x*  + 6R(y  + <590, B,^)  = f(x*,0) 

e-»-0  e,  K)  k-*ao 

k 


continuous  at  e = 0. 


We  should  mention  that  the  continuity  of  f requires  only  the 
continuity  of  f in  addition  to  the  once  (joint)  continuous  differ- 
entiability of  the  constraints. 


4.  Bounds  on  the  Parametric  Variation  of  the  Optimal  Value  Function 


In  this  section  we  are  concerned  with  the  directional  derivative 


of  the  optimal  value  function  for  P(e).  We  first  derive  upper  and 


lower  bounds  on  the  directional  derivative  limit  quotient  of  f (e) 


for  P(e)  and  then  obtain  the  corresponding  bounds  for  P(e).  These 


results  extend  the  work  of  Gauvin  and  Tolle  [11],  who  obtained  the 


analogous  results  for  the  case  in  which  the  perturbation  is  restricted 


to  the  right-hand  side  of  the  constraints 


As  above,  we  will,  without  loss  of  generality,  focus  attention 


on  the  parameter  value  e = 0.  For  zcE  , the  directional  derivative 


of  f*(0)  in  the  direction  z is  defined  to  be 


k 

for  all  unit  vectors  zcE  providing  Bk  is  sufficiently  near  zero. 
Letting  ek  -*■  0 and  without  loss  of  generality,  assuming  * 0 for  all 
n,  setting  ($k  = llekM  and  zk  = ek/||ekM*  we  see  c^at 
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4 


. 

I 


D f*(0>  - 11.  ' f*<°>  , 


B-+0+ 


(4.1) 


providing  that  the  limit  exists. 


Theorem  4.1.  if,  for  ?(c)  , MFCQ  holds  for  some  x*c"?(0) , then,  for 


any  direction  zcE  , 


lim  sup  f <_  max  zv  L(x*,p,0)  . 


B-*-0+ 


PtK(x*,0) 


(4.2) 


Proof.  Let  B satisfy  the  conditions  of  Theorem  3.6,  let  6 > 0 
and  y be  the  vector  given  by  the  constraint  qualification,  and 

- b 

let  y satisfy  eqs.  (3.6)  and  (3.7).  Then,  for  any  zcE  , 
x*  + B(y  + 6y)cK(Bz)  for  Be(0,B]  for  some  B > 0,  so  that 


lim  9UP  < u.  sup  - f (x*to) 

6 “ B-0+  B 


B-H)+ 


f|(x*.0) 


- (y  + 6y)Vf(x*,0)  + zV£f(x*,0). 


Since  this  inequality  is  satisfied  for  arbitrary  6 > 0 we  can 
take  the  limit  as  6 + 0 and  obtain: 


lim  sup  - -( ‘ - ~ ^ < y Vf(x*,Q)  + zV  f(x*,0) 

B-0+  B E 
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I 


The  conclusion  now  follows  by  applying  (3.7): 
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lim  sup  ~ 1 ^).  <_  max  [-zV  ’ g(x* , 0)  p ] + zV  f(x*,0) 

3->0+  3 U£^(x*,0)  £ E 


= max  z 7 L(x*,p,0). 

ue£(x*,0)  L 


F 


A 


Corollary  4.2.  Under  the  hypotheses  of  the  previous  theorem,  if 
MFCQ  holds  at  each  point  xe?(0) , then 

lim  sup  ^ ^ ^ ± inf  max  zV  L(x,p,0).  (4.3) 

6-*0+  xei>(0)  ueK(x,0)  C 

Proof . The  result  follows  directly  by  applying  the  previous  theorem 
at  each  point  of  S*(0). 

Theorem  43,  If,  for  ^(c),  R(0)  is  nonempty,  K(e)  is  uniformly  com- 
pact near  e = 0,  and  MFCQ  holds  for  each  x*e1>(0),  then,  for  any 
direction  zeE  , z a unit  vector, 

(4.4) 


lim  inf  >.  min  zV  L(x*,u,0) 

3-0+  3 MeK(x*,0)  E 


holds  for  some  x*eJ>(0)  . 


Proof.  Let  x eS(3  z)  and  let  3 > 0+  be  such  that 

n n n 


llm  inf  f*m  . lim  __H_!1 


f(x  .6  z)  - f (x*,0) 


3-*-0+ 


n-*-oo 


1 


! 


23  - 


T-  393 


Since  R(e)  is  uniformly  compact,  there  exists  a subsequence,  which  we 
again  denote  by  {x^},  and  a vector  x*  such  that  -*•  x*.  By  Lemma  3.8 
?f(c)  is  u.s.c.  at  c * 0 so  x*eff(o).  Since  we  showed  in  Theorem  3.9 
that  f*(e)  is  continuous,  it  follows  that  x*ci>(0) . Then,  since 
Theorem  3.7  assures  that  x^  + 6n (y  + 6y)elT(0)  for  n sufficiently  large, 
it  follows  that 


lim  inf 

6 *o+ 


f*(6z)  - f*< 


> lim 


f(xn>en2)  “ f(x  »0) 


f^xn'en2^  “ f^xn  + 0n^  + ^ 


«*  lim  [-(y  + 5>0Vf(a  ) + zV  f(a  )] 
n-»oo 


by  the  mean  value  theorem,  where  an  is  the  usual  convex  combination 
(in  En  15  x E^)  of  the  two  arguments  in  the  preceding  quotient.  Thus, 


lim  inf 

e-*o+ 


E*(Bz)  - f*< 


lim  z V f (a  ) - (y  + Sjf)  Vf(a  ) 
n—oo 


z VEf(x",0)  - (y  + 67)  Vf (x  ,0) 


Using  (3.9)  and  noting  that  6 was  chosen  as  any  positive  value,  we 
conclude  that  for  any  x*eS>(0)  where  MFCQ  holds, 

lim  inf  f f > 2 V f (x*,0)  - max  [zV  g(x*,0)w] 

6-0+  6 “ £ mcX(x*,0)  £ 


- min  z V L(x*,p,0). 

uet£(x*,0)  E 


Corollary  4.4.  Under  the  hypotheses  of  the  previous  theorem 


Now,  by  the  reduction  of  variables  that  was  applied  earlier,  we 


see  that,  in  a neighborhood  of  (x 


with  x 


that 


with  f (x, e)  = f(x  ,e),  g(x,c)  = ?(x  ,e),  and  h(x,e)  = h(x  e)  = 0.  Thus 


p,e)  in  a neighborhood  of  (x^Cx^ 


and,  with  to  determined  by  to 


it  follows 


easily  that  7 L = V L and  the  linear  program  appearing  in  the  proof 


of  Theorem  3.3  can  readily  be  formulated  analogously  as  an  equivalent 


problem  in  terms  of  L(x,p,to,c).  Thus,  all  of  the  results  obtained 


above  for  P(e)  can  be  immediately  generalized  to  P(e).  For  complete 


ness,  we  state  these  results  as  the  next  Theorem 


Theorem  A. 5.  If,  for  P(e),  R(0)  is  nonempty  and  MFCQ  holds  at  each 
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and  if  R(e)  is  uniformly  compact  for  e near  e = 0,  then 

lim  inf  ~ f W inf  min  z v L(x,p,u>,0).  (4.7) 

0-+O+  **  xcS(O)  (p,oj)cK(x,0)  E 

Moreover,  we  are  able  to  obtain  the  existence  of  the  directional 
derivative  of  f*  at  e = 0 by  assuming,  as  Gauvin  and  Tolle  [11]  did 
for  right-hand  side  programs,  the  linear  independence  of  the  binding 
constraint  gradients  at  each  point  x*eS(0). 

Corollary  4.6.  Assume  R(0)  is  nonempty  and  R(e)  is  uniformly  compact 
near  e » 0.  If  the  gradients,  taken  with  respect  to  x,  of  the  con- 
straints binding  at  x*  are  linearly  independent  for  each  x*eS(0), 

JL 

then  for  any  unit  vector  zeE  , D^f  (0)  exists  and  is  given  by 

D f*(0)  = inf  z V L(x,p(x)  ,ui(x)  ,0)  , 

Z xeS(0) 

where  (u(x),uj(x))  is  the  unique  multiplier  vector  associated  with  x. 


Proof . At  any  point  x*eS(0),  the  linear  independence  of  the  binding 
constraint  gradients  implies  the  uniqueness  of  the  Kuhn-Tucker  multi- 
pliers corresponding  to  x*.  Inequalities  (4.6)  and  (4.7)  now  combine 
to  yield  the  desired  result. 


Note  that  in  Corollary  4.6,  if  P(e)  contains  no  inequality  con- 
straints, we  could  replace  inf  by  min  since  p would  not  appear  and 

u>«-V  f V h * which  is  continuous  in  x,  making  zV  L a continuous 
*D  *D  L 

function  of  x minimized  over  S(0),  a compact  set. 

We  may  also  show  that  two  of  the  observations  made  by  Gauvin  and 
Tolle  [11]  about  Dzf*(0)  for  right-hand  side  programs  apply  to  P(e) 
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as  well.  First  if  D f*(0)  *=  - D f*(0),  then 

z -z 


inf  max  ; 

xeS(O)  (u,w)cK(x,0) 


z 7 L(x,u,w,0)  = sup  min 


z V L(x,  p,ui,0)  . (A  .8) 


xeS(O)  (u,u)lK(x,0) 


Thus,  if,  for  all  unit  vectors  zcE*1,  D f*(0)  - - D f*(0)  and 

z -z 


D f (0)  ■ inf  max  z V 

xeS(O)  (m,w)cK(x,0)  C 


z 7 L(x,u,u,0) , 


(4.9) 


then  (4.8)  provides  a necessary  condition  for  the  existence  of  7^f*(0). 
In  addition,  if  (4.8)  holds  for  every  unit  vector  zt.E  and  if  x eS(0) 
is  the  unique  solution  of  P(0),  then  its  associated  Kuhn-Tucker  multi- 
plier vector  is  unique. 

We  next  apply  the  results  derived  above  to  a particular  class 
of  programs.  We  show  in  the  next  theorem  that  if  P(e)  is  a convex 
program  in  x for  t near  c - 0,  i.e.,  if  f(x,e)  and  -g^(x,c), 
i * l,...,m,  are  convex  and  if  hj(x,c),  j - l,...,p,  are  affine  in  x, 
then  Dzf*(0)  exists  and  is  given  by  (4.9).  To  prove  this  result,  we 
will  restrict  our  attention  to  ?(e).  We  are  able  to  do  this  since 
the  functions  hj(x,e)  are  assumed  to  be  affine  in  x and  gi(x,c)  are 
taken  to  be  concave  in  x,  from  which  it  easily  follows  that  g^(x,c) 
is  concave  in  x for  i * l,...,m. 


Theorem  4.7.  In  P(e),  let  f(x,e)  and  -gi(x,c),  i - l,...,m  be  con- 
vex and  let  hj(x,e),  j » l,...,p  be  affine  in  x.  If  R(0)  is  non- 
empty, R(e)  is  uniformly  compact  near  e - 0,  and  MFCQ  holds  for  each 

a k 

x eS(0),  then,  for  any  unit  vector  zcE  , 


D f*(0)  - inf  max  s 

z xeS(O)  (p , to) cK(x,0) 


zV  L(x,p  ,u),0) . 


(4.10) 
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Proof.  Without  loss  of  generality,  we  will  prove  this  result  for 
P(e).  Let  x*eST(0)  and  x^eiTCf^z)  with  $n  -*•  0+  in  such  a way  that 


lim  inf  = lim  -n.  ■ n-  ■ 

8+0+  B n-*-oo  pn 


and  xn  + x*  as  in  the  proof  of  Theorem  4.3.  For  all  p*eK(x*,0), 


L(xn,P  ,6nz)  = f(xn,0nz)  - u*g(xn>Bnz)  < f(xn,Bnz), 


where  the  inequality  follows  from  the  non-negativity  of  both  p and 
g(xn,Bnz)*  Thus,  since  £(x*,p*,0)  = f(x*,0), 


f (x  ,8  z)  - f(x*,0)  L(x  ,p*,8  z)  - L(x*,p*,0) 

, . n n , . n n 

lim  1 lim 

n-+oc  n n~xx>  n 


Now,  as  a result  of  the  Kuhn-Tucker  conditions  and  the  convexity 
assumptions,  x*  is  a global  minimizer  of  L(x,p*,0),  so 


L(x  ,p*,6  z)  - L(x*,p*,0)  L(x  ,p*,8  z)  - T(x  ,p*,0) 

,.nn  n 

lim  g 1 lim  g 

n-+oo  n n-*-oo  pn 


L(x  ,p*,0)  + B zV  L(x  ,p*,t6  z)  - L(x  ,p*,0) 
n n c n n n 


by  the  mean  value  theorem,  where  te(0,l).  Thus 


f(x  ,8  z)  - f (x*,0) 

lim  > lim  zV  L(x  ,p  ,t8  z) , 

8 — „ e n n 

n->oo  n n^-oo 


and,  passing  to  the  limit  on  the  right,  we  are  able  to  conclude  that 
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f(x  ,6  z)  - f (x*,0) 

lim  >.  z7  L(x*,p*,0) . 

n-*-oo  pn 


(4.11) 


Thus,  for  some  x*eS(0) , since  (4.11)  holds  for  each  p*eK(x*,0),  and 
recalling  from  [11]  that  K(x*,0)  is  compact. 


lim  inf  f Z f >_  max  zV  L(x*,y,0), 

6 K)+  yeK(x*,0)  L 


from  which  we  see  that 


lim  inf 
8-0+ 


_>  inf  max  zV  L(x,p,0) 

xesT(O)  ue K(x*,0)  C 


Combining  this  result  with  that  obtained  in  Corollary  4.2  we  conclude 


D f*(0)  - inf  max  zV  L(x,p,0). 
2 xe?(0)  p£K(x,0) 


For  convex  P(c) , (4.10)  now  follows  by  an  inversion  of  the  reduction 


of  variables  process  applied  to  yield  P(t). 


5.  Exa 


We  use  the  example  stated  below  to  demonstrate  the  theoretical 


results  obtained  in  the  previous  sections.  For  the  given  problem  we 


show  that  the  conditions  of  MFCQ  hold  at  every  point  in  S(e)  and  we 


give  the  form  of  the  vector  satisfying  the  constraint  qualification. 


We  then  show  that  the  expected  fora  of  the  vector  satisfies  (2.1)  and 


(2.2)  for  P(e),  and  that  the  bounds  stated  in  (4.6)  and  (4.7)  are 


attained. 
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Consider  Che  program 

min  ex^  P(e) 

s.t.  g(x,e)  = - (Xj-e)2  - (x2*2)2  + 4 _>  0 
h(x,e)  = - Xj^  + x2  + e - 0. 

A A 

The  solution  of  this  program  is  easily  determined  to  be  x^  «*  x2  + e with 

x*  - ^ 0 C>^  , and  if  e = 0,  x*  can  be  any  value  in  the  interval  [0,2].  (5.1) 
2 | 2 t<0 

Applying  the  reduction  of  variables  technique  outlined  earlier,  with 
x^  » x^  and  Xj  * x2>  P(e)  is  transformed  into  the  equivalent  program 


I 


p 


1 '1 


i 


i 

i 

I 
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To  illustrate  Theorem  3.2,  we  first  determine  the  general  form 
of  the  vector,  y,  which  is  guaranteed  at  points  xeS(e)  at  which 
MFCQ  is  satisfied.  The  constraint  gradients  of  P(e)  are 

Vg(x,c)  = [-2(x1-e),  -2(x2-2)],  and 
Vh(x, e)  = [-1,1]. 

Applying  (2.1)  and  (2.2)  at  a point  x*  - (x*,x2)eS(e) , with 
y = (yi»y2)»  we  have  Vg(x*,e)  y = -2 (x*-e)  y1  - 2(x2~2)  y2  > 0 if 
g(x*,0)  = 0,  and 

Vh(x*,e)  y =*  -y^  + y2  = 0* 

Thus,  for  any  value  of  e,  since  g(x,e)  is  binding  only  if  x2e{0,2), 
y can  have  the  form 


(a, a) 

x*  ■=  0 

y 

s < 

(b,b) 

0 < x2  < 2 , 

(5.4) 

. (c,c) 

x2  * 2 

for  any  real  numbers 

a,l 

3,c  with 

a > 0,  b arbitrary,  and  c < 0. 

We 

can  also  conclude  that  MFCQ  holds  at  every  solution  of  P(e). 

In  a similar  fashion,  we  see  that,  for  P(e), 

Vg(x2,e)  - -2x2  - 2(x2-2), 

so  applying  (2.1)  we  find  that  the  vector  yj  in  the  reduced 
program  takes  the  same  form  as  the  second  component  of  y in  (5.4). 
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Now 

VL(x,p,u>,e)  = [c  + 2vi(x1~e)  - u>,  2ii(x,,-2)  + w], 

so  that  at  a solution  x*eS(0)  we  must  have  2px*  - w = 0 for 
(p,u>)eK(x*,0) . Then 

VeL(x*,m,w,0)  * x*  , 

2 

and,  with  S(0)  = {xeE  : Xj-x2,  x2e[0,2]}, 

0 z = 1 

min  max  z V L(x,u,w,0)  = . (5.5) 

xeS(O)  (u,w) cK(x,0)  Z -2  z = -1 

Comparing  (5.3)  with  (5.5)  we  see  that  (4.6)  holds  with  equality. 

Now,  considering  inequality  (4.7),  we  first  note  that  for  any 
» 1 

neighborhood  N(0)  of  OeE  , the  closure  of  the  set 

{xeE^:  x » (x2+c,  x2) , x2e[0,2],  e in  N(0)}  is  compact  so  R(e)  is 

uniformly  compact  for  e near  e = 0.  We  calculate 

0 z - 1 

min  min  z V L(x,ij,w,0)  = , 

xeS(O)  (u,oi) eK(x,0)  E -2  z - -1 

and  find  that  (4.7)  also  holds  with  equality. 

An  example  is  given  in  [11]  which  illustrates  that  (4.6)  and 
(4.7)  need  not  hold  with  equality. 


- 


i 


I 


6.  Related  Results 

Inspection  of  the  derivation  of  (4.6)  and  (4.7)  reveals  that  the 
bounding  term  in  these  expressions,  namely  z7eL(x,y ,w,0) , can  be 
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viewed  as  the  sum  of  two  distinct  expressions,  one  resulting  from  the 
variation  of  the  objective  function  of  P(e)  with  respect  to  the 
parameter,  the  other  deriving  from  the  dependence  of  the  region  of 
feasibility  on  the  parameter.  The  first  of  these  terms  is  z Vtf(x,0) 
and  is  easily  seen  to  result  directly  from  the  manipulation  of  the 
limit  quotients  in  the  proofs  of  Theorems  4.1  and  4.3.  The  second 
component,  z[-V^g(x,0)p  + V^h(x, ejm] , results  from  the  assumption  that 
MFCQ  holds  at  points  of  S(0).  The  conditions  of  MFCQ  are  invoked  to 
enable  us  to  conclude  (3.7)  and  (3.9),  as  well  as  the  existence  of 
points  feasible  to  P(e)  in  a neighborhood  of  e = 0.  Having  made 


these  observations,  we  are  now  able  to  discuss  the  relationships 


between  the  bounds  provided  here  and  results  previously  obtained  by 
others.  As  we  shall  see,  in  particular  instances  in  which  the  direc- 
tional derivative  of  f*  is  shown  to  exist,  it  is  expressed  as  either 
a function  of  V f or  a function  of  V g and  V h,  or  a combination  of 

e e e 


all  of  these  terms,  depending,  as  one  would  suspect,  on  where  in 
P(e)  the  parameter  appears. 

Danskin  [5,6]  provided  a now  well-known  characterization  of  the 
directional  derivative  of  the  optimal  value  function  of  P(e)  in  the 
case  that  the  constraints  are  independent  of  a parameter.  Under  the 


conditions  that  the  region  of  feasibility,  R(0),  is  compact,  and 
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Relating  our  hypotheses  to  Danskin's  construct,  we  first  note  the 
equivalence  of  our  assumption  of  the  uniform  compactness  of  R(e)  for 
e near  e = 0,  and  the  assumption  that  the  feasible  region  is  compact 
if  the  constraints  of  P(e)  do  not  depend  on  e . To  see  this,  one  need 
only  consider  that,  in  this  case,  R(e)  = R(0)  for  all  c and  apply 
Definition  2.3.  In  addition,  when  the  feasible  region  is  independent 
of  c,  our  development  need  not  consider  the  perturbed  point 
x*  + 8(y  + 550 , but  may  be  restricted  to  the  point  x*eS(0).  The 


proofs  of  Theorems  4.1  and  4.2  remain  valid  in  this  case  by  simply 
suppressing  all  reference  to  the  dependence  of  the  constraints  on  e 


and  by  considering  the  unperturbed  point  x*  instead  of  x*  + fl(y  + 6^) . 
One  is  then  led  to  conclude  that,  analogous  to  (4.6)  and  (4.7), 


lim  sup  1 C£z)  ~...£  AQ).  min  z y f (x,0) , and  (6.2) 

6-0+  S xcS(O)  £ 


_>  min 
xeS(O) 


Thus  it  follows  that,  under  the  stated 


conditions,  namely  the  compactness  of  R and  the  continuity  of  f(x, e) 


and  V f(x,e)  at  c = 0,  our  results  are  consistent  with  those  of 


Danskin  in  that  they  verify  the  existence  of  D f (0)  and  show  (from 


(6.2)  and  (6.3))  that  it  can  be  expressed  as  in  (6.1) 


Gauvin  and  Tolle  [11]  showed,  for  programs  with  right-hand  side 


for  programs  of  the  form 


perturbations,  i.e 
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I 


* 


i 


min  f(x) 

s.t.  gi(x)  _>  (i«l,...,m). 


h.(x)  = (J-l,...,p), 


P'(e) 


that  although  the  directional  derivative  of  f may  not  exist,  its 
limit  quotient  can  be  bounded.  In  particular,  they  concluded  that 
if  MFCQ  holds  at  each  element  of  S(0)  and  if  R(r)  is  uniformly  compact 


for  e near  c = 0,  the  following  inequalities  are  satisfied: 

, , f*(bz)  - f*(0)  . , / “ £ \ 

lim  sup 1 < inf  max  V u.z.  - V w,  z , , 

3 “ /.  0)'i«l  1 1 jti  J **3' 


(6 


6-*-0+ 


xeS(O)  (p,w)eK(x, 


and 


lim  inf 
b*0+ 


f*(dz)  - f*(0) 

« >.  inf 

* xeS(O) 


min  I L'  u.z 

(u.wJcKU.O, 'i-1 


P 

3 = 1 


Now,  from  (4.6)  and  (4.7)  we  see  that  the  bounds  we  have  given  for 
the  general  program  P(c)  reduce  to  those  in  (6.4)  and  (6.3)  respec- 
tively for  the  more  restrictive  perturbations  appearing  in  P'(e). 

In  the  case  of  convex  programs,  the  existence  of  D^f^O)  assured 
by  Theorem  4.7,  and  its  expression  as  (4.10),  corresponds  under 
slightly  different  assumptions,  with  results  achieved  by  Gol' stein 
[12]  and  Hogan  [15].  Theorem  4.7  is  a direct  extension  to  the  general 
perturbed  mathematical  program  of  a result  given  by  Gauvin  and  Tolle 
[11]  for  right-hand  side  programs. 

In  an  as  yet  unpublished  manuscript  communicated  to  us  by 
J.  Gauvin,  A.  Auslender  has  apparently  extended  the  results  of  Gauvin 
and  Tolle  [11]  to  problems  involving  non-dif f erentiable  functions.  In 
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particular,  the  bounds  noted  by  (6.4)  and  (6.5)  are  obtained  for 
right-hand  side  programs  in  which  the  problem  functions  are  locally 
Lipschitz  and  those  defining  the  equality  constraints  are  continuously 
differentiable.  We  are  currently  studying  this  result  to  understand 
the  relationship  between  our  assumptions  and  those  of  Auslender  and 
to  determine  if  Auslender 's  result  extends  to  Che  more  general  pro- 
gram P(e) . 
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